Correlated couplings and robustness of coupled networks 
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Most real-world complex systems can be modelled by coupled networks with multiple layers. How 
and to what extent the pattern of couplings between network layers may influence the interlaced 
structure and function of coupled networks are not clearly understood. Here we study the impact 
of correlated inter-layer couplings on the network robustness of coupled networks using percolation 
concept. We found that the positive correlated inter-layer coupling enhances network robustness 
in the sense that it lowers the percolation threshold of the interlaced network than the negative 
correlated coupling case. At the same time, however, positive inter-layer correlation leads to smaller 
giant component size in the well-connected region, suggesting potential disadvantage for network 
connectivity, as demonstrated also with some real-world coupled network strucutres. 

PACS numbers: 89.75.Hc, 89.75.Fb 



In the past decade, network has proved to be a use- 
ful framework to model structural complexity of com- 
plex systems 0, HJ. By abstracting a complex system 
into nodes (constituents) and links (interactions between 
them), the resulting graph could be efficiently treated an- 
alytically and numerically, through which a large body of 
new physics of complex systems has been acquired [3, |j] . 
Most studies until recently have focused on the proper- 
ties of isolated, single networks, such as the World wide 
web, coauthorship network of a specific subject, and the 
metabolic network of a microorganism. In most, if not 
all, situations, however, a network in question is merely 
a part of a larger system; world wide web could only 
function properly in conjuction with physical network of 
routers, a researcher could take part in multiple social 
networks via various professional or informal relation- 
ships other than coauthorship relations, and a protein 
in a cell could function both as a metabolic enzyme and 
by binding with other proteins, thereby taking part in 
both metabolic and protein networks. Therefore, a more 
complete description of complex systems would be a sys- 
tem of networks coupled one another. Typical forms of 
network coupling would be layered structure [5|, multi- 
plexity of links p , and interaction Q or interdependency 
[8j between network layers. 

Only recently, such coupled network structures have 
started to be studied actively Leicht and D'Souza 

Q studied what they called interacting networks, in 
which two networks are coupled via inter-network edges, 
and developed a generating function formalism to study 
their percolation properties. Buldyrev et al. [8] studied 
the interdependent networks, in which mutual connec- 
tivity in two network layers plays an important role, and 
found that catastrophic cascades of failure generically oc- 
cur due to the interdependency. In both studies, network 
layers are coupled in an uncorrelated way, in the sense 
that the connections or pairings between nodes in dif- 
ferent layers are taken to be random. In real complex 
systems, however, correlated inter-layer couplings can be 



siginificant. For example, one may expect that a person 
with many friends in one social network would also have 
many friends in another social network, being a friendly 
person. Such correlated coupling may alter the inter- 
laced connectivity structure and large-scale properties 
of dynamic processes on the coupled networks, such as 



network robustness 11 1 or cascading failures [8, TtJ 12 1 
Therefore, the impact of correlated inter-layer coupling to 
system's structure and function needs to be understood. 

In this paper, we study how the network robustness 
is affected by the correlated inter-layer coupling in two- 
layer coupled networks. Specifically, we consider two net- 
works with identical set of N nodes. They can be indi- 
viduals participating in two different social networks or 
proteins with activities via enzymes and multi-protein 
assembly. Each layer I is specificed with the intra-layer 
degree distribution ir^'(ki), where degree ki is the num- 
ber of links within layer I (intra-layer links) of the node. 
The coupled network can be specified by the joint degree 
distribution n(/ci, A^). Generalization into I > 2 layers is 
straightforward, and in this study we restrict ourselves 
to I = 2 case. Next the network layers are overlaid one 
another, and the interlaced network is constructed. The 
degree of a node in the interlaced network is given by 
k — k\ + k% — k a , where k Q denotes the number of links 
overlapping in the two layers, which can be neglected 
in sparse networks. Therefore, the generating function 
Gq(x) for the degree distribution P(k) of the interlaced 
network can be written as 



G {x) = Y,P{k)x k = n(fci,fc 2 ); 
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(1) 
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The primary quantity of interest is the size of giant com- 
ponent S of the interlaced network, given by the fraction 
of nodes belonging to the largest component in the limit 
N — > oo. Following standard generating function tech- 
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131 ] - S can be obtained via 



S = l-G (x*), 



(2) 
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FIG. 1. (Color Online) The giant component size S of inter- 
laced networks of two ER networks in the absence of inter- 
layer correlations is plotted as a function of (fci) for various 
(fo). Nmerical simulation results obtained with N = 10 4 
nodes (points) and theoretical curves obtained by the gener- 
ating function method (solid lines) are shown together. 



with x* being the solution of x — G\(x), where G\{x) — 
jj£\-^Go( x ) is the generating function of the probabil- 
ity distribution of remaing degrees q = fc — 1 (fc > 1). 
The condition for existence of the giant component (that 
is, S > 0) is given by the Molloy-Reed criterion 
J2k — 2)P(fc) > 0. Therefore, understanding of how 
the inter-layer coupling correlation encoded in the joint 
degree distribution H(kx,k2) translates into the degree 
distribution P(fc) of the interlaced network can provide 
critical insight on network robustness. 

In the absence of inter-layer correlations, the 
joint degree distribution factorizes, Uu ncorr (fei, £2) = 
tt^ 1 ' (ki)^ 2 ' $2) , and therefore the degree distribution 
of the interlaced network is given by the convolution of 

TT^Hh), Puncorr(k) = £ fel 7T« (k,)^ (k - fc X ), and its 



generating function GQ ncorr (x) = (x)g^' (x), where 
gH\x) is the generating function of ir^(ki). In the pres- 
ence of inter-layer correlations, however, P(k) is related 
with n^(ki) in a nontrivial way. 

To gain more insight, we consider specific network 
models. First we consider two layers of Erdos-Renyi (ER) 
networks with mean degrees (fci) and (fe), respectively. 
For the uncorrelated case, one can proceed with exact 
calculations as Gq(x) = e^-iHC^Hz-i^ f rom w hi c h S 
can be obtained using Eq. (2). The interlaced network 
is nothing but another ER network with mean degree 
(fc) = (kx) + (fe)' Numerical simulations with two-layer 
ER networks with N = 10 4 perfectly confirmed this the- 
oretical prediction (Fig. 1). Percolation transition occurs 
when (hi) + (fe) = 1. 

Next we introduce the correlated inter-layer coupling 
in the two-layer networks. For simplicity, we consider 
two extreme cases of maximally-positive and maximally- 
negative correlations. In the maximally-positive inter- 
layer correlation, the ranks in degrees of a node in the 
two layers are equal, meaning that the highest degree 
node in one layer is also the highest degree node in the 
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other layer, and similarly for the lowest degree nodes. 
Specifically, the Spearman rank correlation coefficient r s 
of the degrees of a node, defined by 
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where Aj is the difference in the ranks of node i's degrees 
in the two layers, is w 1. In the maximally-negative 

case, it is the opposite that the highest degree node in 
one layer has the lowest degree in the other layer, hav- 
ing the reverse ordering of ranks. In this case, the rank 
correlation coefficient is ri™ 69 -* ss — 1 [l5j |. 

To construct the networks with maximal correlations, 
we arrange the nodes in the order of their degrees in 
each layer and match two nodes from each layer in order 
of the degree-rank (maximally-positive) or in the oppo- 
site order of the degree-rank (maximally- negative). We 
performed numerical simulations following this procedure 
for the two-layer ER networks and measured the size of 
giant component as a function of (hi) with fixed (£2) 
(Fig. 2, points). We also performed the following mean- 
freld-like numerical calculations for P(fc) for both cases 
and used them to obtain S through Eqs. (1-2), which 
are found to agree with the numerical simulation results 
remarkably well (Fig. 2, lines). For maximally-positive 
case, we setup two ordered sequences obtained from the 
cumulative intra-layer degree distribution, T^ mu j(^) = 
SfcLo ^(k), of each layer I, and merge them to make 
another ordered sequence. This sequence is nothing but 
the cumulative distribution of P(fc), from which we can 
calculate P(k) easily. For maximally-negative case, we 
need to use two ordered sequences given by the cumu- 
lative degree distribution in one layer and the comple- 
mentary cumulative degree distribution, ^complei^l) = 

1 — J2k=o t^(^)j m the other layer. 

Both numerical simulations and mean-field-like calcu- 
lations show that in the maximally-positive case, the gi- 
ant component emerges much earlier than in the uncor- 
related case. For example, with (£2) = 0.2 [Fig. 2(a)], 
which is well below the percolation threshold of a single 
ER network, the giant component emerges at as early as 
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(pos) 



0.10 (o), much earlier than the uncorrelated 



case where it does at (fci) 



(uncorr) 



0.8 (□). This means 



that we only need less than a third of links ( (fc) 



(pos) 



0.3 



vs. {k)i uncorr ^ = 1) to attain global connectivity in the 
maximally-positive case with (fc 2 ) = 0.2, compared with 
the uncorrelated case. By contrast, in the maximally- 
negative case, the giant component emerges much later. 
For example, with (fc 2 ) = 1 [Fig. 2(b)], exactly the perco- 
lation threshold of a single ER network, the giant compo- 



nent does not grow to a finite size until (fci 



Xneg) 



0.65 



(A), that is, (fc) 



(neg) 



1.65 at {k2) = 1, meaning that, 



surprisingly, additions of about two thirds more links 
onto the giant component at the single network perco- 
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FIG. 2. (Color Online) The size of giant component S of the 
coupled ER networks with two layers, with the mean degree 
of the second layer fixed to be (£2) = 0.2 (a), 1.0 (b), and 2.0 
(c). Numerical simulation results for 5* in uncorrelated (□), 
maximally-positive (o), and maximally-negative (A) cases are 
presented, along with the mean-field-like calculation results 
(lines). (Insets) The degree distribution P(k) of the interlaced 
networks in the three cases for (fci) = 1.0 (a,c) and 0.4 (b). 



lation point do not make it grow any larger. Therefore 
we need much more links to attain global connectivity in 
the maximally-negative case compared with the uncorre- 
lated case. In this sense, the positive coupling between 
layers renders the coupled network more robust under 
random failures, whereas the negative coupling decreases 
the robustness. These distinct behaviors arise due to the 
different shapes of degree distribution in each case. For 
positive correlation case, the degree distribution becomes 
broader than the uncorrelated case, whereas it gets nar- 
rower in the negative correlation case, leading to smaller 
degree variance (Fig. 2, insets). 

Although the giant component emerges earlier with 
positive inter-layer coupling, it grows more gradually 
than the negative correlation case, for which it exhibits 
a more abrupt increase near the percolation threshold 



and faster saturation towards S — > 1 (Fig. 2). This sug- 
gests an interesting perspective to network robustness; on 
one hand, the coupled network with positive inter-layer 
correlations is more robust since it can support global 
connectivity with lower density of links, whereas on the 
other hand, the early impact of link removals from a well- 
connected network can be more severe, as S is smaller for 
the positive correlation case than for the negative corre- 
lation case in the region S > 0.6. This behavior can also 
be seen in Fig. 2(c), where the giant component size S 
is plotted against (ki) with (fo) = 2, well above the per- 
colation threshold. In this case, the maximally-negative 
correlation case exhibits larger S than the maximally- 
positive case in the whole range of {k± } we studied. These 
results are somewhat similar to the effect of degree mix- 
ing pattern in the single network fl6j ] . 

We performed the same calculations for coupled net- 
works with two layers of scale-free (SF) networks hav- 
ing identical degree distributions of a power-law form, 
n"'(ki) ~ &; -7 , with the degree exponent 7 = 2.3 and 3.0 
using the static model [17J, and obtained qualitatively 
same results. 

Finally, we consider real-world examples of coupled 
network structures. The first example is the cellular 
network of a bacterium called Mycoplasma pneumoniae 
[l~8| , in which nodes are genes or gene products and links 
are the physical bindings to form protein assemblies in 
the protein-protein interaction layer and the sharing of 
metabolites in reactions catalyzed by two enzymes in the 
metabolic layer. The second example is the world trade 
network nana, in which the nodes are countries and 
links are trade relations between them, with two layers 
corresponding to commodity trades in the primary and 
the secondary industrial sectors, respectively. 

We studied the robustness properties of these coupled 
networks under random failures by successively remov- 
ing links randomly. In particular we measured the giant 
component size S as a function of the fraction of links re- 
moved / for the interlaced networks (Fig. 3, o). We com- 
pared the results with the randomized coupled networks 
by randomly shuffling the node identities in the two lay- 
ers with the intra-layer connectivity intact, by which we 
could obtain the uncorrelated coupled networks (Fig. 3, 
□). Furthermore, we constructed the maximally-positive 
(Fig. 3, o) and maximally-negative (Fig. 3, A) corre- 
lated coupled networks, by ordered-matching and anti- 
ordered-matching of degree ranks in the two layers as in 
the model networks. As both real- world networks have 
broad intra-layer degree distributions, often of a power- 
law form with 7 < 3, both the coupled networks show 
extreme resilience under random failures, that is the gi- 
ant component sustains (S > 0) until we remove almost 
the entire links (/ c « 1). Distinct characteristics, how- 
ever, can be observed when we compare them with cor- 
responding randomized networks. The cellular network 
of M. pneumoniae behaves similarly to the uncorrelated 
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FIG. 3. (Color Online) Robustness of real-world coupled net- 
works under random removal of links. The size of remaining 
giant component 5* after a random removal of fraction / of 
links (o) is plotted for the cellular network of M. pneumoniae 
(a) and the world trade network (b), along with that for cor- 
responding randomized uncorrelated (□), maximally-positive 
correlated (o), and maximally-negative correlated networks 
(A). 



randomized networks [Fig. 3(a)], whereas the world trade 
network behaves closely to the maximally-positive corre- 
lated case [Fig. 3(b)], suggesting a fundamental differ- 
ence in the inter-layer coupling structure in these two 
systems. Indeed, the inter-layer degree rank correlation 



is measured to be weak for the former, 



ell ala 



= 0.11, 



whereas it is found to be very strongly positive for the 
latter, r* rade = 0.86, consistent with expectations based 
on the model network results. 

To conclude, we have studied the effect of correlated 
inter-layer couplings on the network robustness of cou- 
pled network structures, using both model networks and 
real-world networks. It is shown that the positive inter- 
layer correlation in degrees renders the network robust- 
ness increase in the sense that the percolation thresh- 
old is lowered. At the same time, the giant component, 
once formed, grows much more gradually, or equivalently, 
decays much quickly under initial random link removal, 
for positive inter-layer correlations, which has an impor- 
tant implication for real-world networks with scale-free 
topology. We have shown that the correlated coupling 
between network layers affects critically the structural 
properties of coupled network system, a better repre- 
sentation of most real-world complex systems than the 
single, isolated network. Its impact on other dynamic 
processes occurring on coupled network systems is to be 



explored [10(. Finally, higher-order correlation factors 
within and between network layers, such as link over- 
laps, mixing, clustering, and community patterns, could 
also induce other nontrivial impact on coupled network 
structure and dynamics, opening a wide avenue for future 
studies. 
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